Goto

Collaborating Authors

 Arkhangelsk Oblast


CoCoA: Confidence and Context-Aware Adaptive Decoding for Resolving Knowledge Conflicts in Large Language Models

Khandelwal, Anant, Gupta, Manish, Agrawal, Puneet

arXiv.org Artificial Intelligence

Faithful generation in large language models (LLMs) is challenged by knowledge conflicts between parametric memory and external context. Existing contrastive decoding methods tuned specifically to handle conflict often lack adaptability and can degrade performance in low conflict settings. We introduce CoCoA (Confidence- and Context-Aware Adaptive Decoding), a novel token-level algorithm for principled conflict resolution and enhanced faithfulness. CoCoA resolves conflict by utilizing confidence-aware measures (entropy gap and contextual peakedness) and the generalized divergence between the parametric and contextual distributions. Crucially, CoCoA maintains strong performance even in low conflict settings. Extensive experiments across multiple LLMs on diverse Question Answering (QA), Summarization, and Long-Form Question Answering (LFQA) benchmarks demonstrate CoCoA's state-of-the-art performance over strong baselines like AdaCAD. It yields significant gains in QA accuracy, up to 9.2 points on average compared to the strong baseline AdaCAD, and improves factuality in summarization and LFQA by up to 2.5 points on average across key benchmarks. Additionally, it demonstrates superior sensitivity to conflict variations. CoCoA enables more informed, context-aware, and ultimately more faithful token generation.


Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization

Huang, Lei, Feng, Xiaocheng, Ma, Weitao, Fan, Yuchun, Feng, Xiachong, Ye, Yangfan, Zhong, Weihong, Gu, Yuxuan, Wang, Baoxin, Wu, Dayong, Hu, Guoping, Qin, Bing

arXiv.org Artificial Intelligence

Ensuring contextual faithfulness in retrieval-augmented large language models (LLMs) is crucial for building trustworthy information-seeking systems, particularly in long-form question-answering (LFQA) scenarios. In this work, we identify a salient correlation between LFQA faithfulness and retrieval heads, a set of attention heads responsible for retrieving contextual information. Leveraging this insight, we propose RHIO, a framework designed to teach LLMs to explicitly discriminate between faithful and unfaithful generations. RHIO first augments unfaithful samples that simulate realistic model-intrinsic errors by selectively masking retrieval heads. Then, these samples are incorporated into joint training, enabling the model to distinguish unfaithful outputs from faithful ones conditioned on control tokens. Furthermore, these control tokens are leveraged to self-induce contrastive outputs, amplifying their difference through contrastive decoding. Additionally, to facilitate the evaluation of contextual faithfulness, we also introduce GroundBench, a comprehensive benchmark compiled from five existing LFQA datasets. Extensive experimental results on GroundBench demonstrate that RHIO significantly improves faithfulness, even outperforming GPT-4o.


International underwater cable attacks by Russia, China are no 'mere coincidence' warns EU's top diplomat

FOX News

Attacks on underwater cables running through strategically significant bodies of water in both the Baltic Sea and the South China Sea by Russia and China, respectively, in recent months has top officials concerned they are not "mere coincidence." Maritime sabotage efforts in both regions of the world appear to have been on the rise over the last several years, with a notable spike in recent months after at least three separate attacks occurred in as many months, beginning in November, and the top suspects are Russia and China. "The Kremlin has been running a hybrid campaign against Europe for years, ranging from spreading disinformation and cyberattacks to weaponizing energy supplies. Since Russia's full-scale invasion of Ukraine, these efforts have intensified dramatically," EU High Representative Kaja Kallas told Fox News Digital. "However, Russia is not the only challenge we face."


Senate to vote on contentious Arctic ambassador nominee with deep ties to China and Russia

FOX News

Fox News' Bill Hemmer discusses his trip to join the U.S. Navy in the Arctic Circle and tour a nuclear submarine. When the Biden administration nominated Michael Sfraga to be special ambassador to the Arctic, he failed to disclose his deep history with Russia and China. The Senate is expected to vote on Sfraga's confirmation on Tuesday – over a year after his nomination, which was held up by Republicans who claim he is too close to U.S. adversaries. Sfraga has traveled extensively across Russia and China, and even spoke at an event where Russian President Vladimir Putin gave the headline address. An Alaskan and geographer by background, Sfraga chairs the Polar Institute and the U.S. Arctic Research Commission.


Early Detection of Bark Beetle Attack Using Remote Sensing and Machine Learning: A Review

Marvasti-Zadeh, Seyed Mojtaba, Goodsman, Devin, Ray, Nilanjan, Erbilgin, Nadir

arXiv.org Artificial Intelligence

This paper provides a comprehensive review of past and current advances in the early detection of bark beetle-induced tree mortality from three primary perspectives: bark beetle & host interactions, RS, and ML/DL. In contrast to prior efforts, this review encompasses all RS systems and emphasizes ML/DL methods to investigate their strengths and weaknesses. We parse existing literature based on multi- or hyper-spectral analyses and distill their knowledge based on: bark beetle species & attack phases with a primary emphasis on early stages of attacks, host trees, study regions, RS platforms & sensors, spectral/spatial/temporal resolutions, spectral signatures, spectral vegetation indices (SVIs), ML approaches, learning schemes, task categories, models, algorithms, classes/clusters, features, and DL networks & architectures. Although DL-based methods and the random forest (RF) algorithm showed promising results, highlighting their potential to detect subtle changes across visible, thermal, and short-wave infrared (SWIR) spectral regions, they still have limited effectiveness and high uncertainties. To inspire novel solutions to these shortcomings, we delve into the principal challenges & opportunities from different perspectives, enabling a deeper understanding of the current state of research and guiding future research directions.


New Artificial Intelligence Algorithms

#artificialintelligence

According to a report on the website of the National Institute of Standards and Technology on November 24, a multi-institutional team from the National Institute of Standards and Technology, the University of Maryland and the Stanford Linear Accelerator Center (SLAC) of the U.S. Department of Energy has developed a closed-loop material exploration and optimization based on artificial intelligence The system (CAMEO) algorithm aims to use the self-learning characteristics of the algorithm to discover complex new materials with specific properties through fewer experiments, to help scientists minimize the time of trial and error in experiments and improve the efficiency of new material development. The research team connected the X-ray diffraction equipment to a computer equipped with the CAMEO algorithm and imported the existing material database into the algorithm. After many iterations of learning, only a small amount of routine measurement can be used to find The best material for specific properties. Using this method, researchers discovered new nanocomposite phase change memory materials among 177 possible materials. The number of test iterations required was reduced to 1/10 of the original, and the time required was shortened from 90 hours.